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1.  INTRODUCTION 

Previous  work  on  design  of  nom'ecarsive  digital  filters  which  are 
identical  imt thematically  to  uniformly-spaced  linear  aiitenna  arrays  [l],  has 
minimized  a quadratic  error  criterion,  subject  to  inequality  constraints  on 
the  maxinrrmi  error  in  the  filter  approximation,  at  an  arbitr.ai’y  but  finite 
number  of  points.  Qiiadratic  error  and  maximum  error  can  be  made  to  correspond, 
respectively,  to  total  stopband  noise  power  £and  maxharum  passband  error  at  a 
single  fi-equency.  In  the  fol’’ ow i’lg,  a weig’nted  sum  of  the  iw'o  ei>ror  criteria 
will  be  minimized  by  use  of  quadratic  prograarni ;rg.  Rirtliermore , any  solution 
to  the  constrained  quadratic  irdnimization  pi’oblom  will  be  shown  to  be  a solu- 
tion to  a weigiited  si;m  minijni zation  pi'obiem,  and  vice  vei'sa. 


P . STATMaENT  OP  Ilg  MATHrMATICAL  PROHLKMS 

The  design  of  a low  pass  filter  c-in  be  viewed  as  an  appi'oxim.ation  of 
the  function 


1 if  0 < t < t , 
f(t)  = P 

0 < ■t  1 0.5, 


where  0 < t < t < 0.5» 
P 3 


The  interval 


[O,  tp]  is 


called  the  passband  and 


[tg,  0.5]  called  the 


■■•at'- on  ''3  done  by  ncaTis  of 


stopband 


I'le  approx 


2 


liiioar  Otimbimt j 0113 


h(t)  = 2 a,  cos  2nc  t 

k^-0  ^ ^ 


0-0  1 t < 0.5 


w'ricre  the  are  ndn-negatlve  reals,  sti-ictly  Increasing  with  k and 

c -^0;  also  the  a,  's  are  real, 
o k 

'riiC  noiTi  which  will  be  used  is  the  ''mixtr'd  noi'ic"  defined  for  every  real 
fijiction  g,  continuoiis  on  both  [o,  t^]  and  [t^,  0.5]  by: 


II  g iP  = A.  max  I«(t)l^  + (1  - '■)  f w(t)  |g(t)i^  dt 

r\  y 4-  y 4-  v 


0 < t < t 

— — p 


with  some  fixed  K,  0 < A < 1,  and  some  fixed  positive  continuous  real-valued 

f’anction  ui  defined  on  [o,  t ] U [t  , 0.5].  The  fact  that  this  definition  de- 

P 3 

termines  a norm  is  obvious  except  for  the  triar.gle  inequalityj  its  proof  ap- 
pears in  the  Appendix. 

Our  problem,  P(X),  is  to  find  a best  approximation  to  f,  namely. 


nnnimize  1 


(•)  - S a^  CCS  2tic  (•) 

yr^O  ^ ^ 


However,  for  computational  purposes,  we  substitute  for  it  another  problem, 
P (a),  obtained  by  discretizing  the  passband,  problem 


minimize  II  f(-)  - 2 a^  cos  2nCj^(  • ) IIq 

\ k.0 


Kn  fe,  for  every  g :S  above. 


3 


il  «lPn 


1=1, . . . ,ra 


+ (''■-^)  J lg(t)|^  dt 


and  <t^<t_<...<t  <t  ai'e  given  numbers.  P„(X)  I’educes  to  a 
L d rn  — p D 

quadi'atic  prograjnrni ng  pi'oblem. 

Kach  of  P(X)  and  Pq(^)  bas  a unique  solution,  ’ieitlier  [j  * ||  nor 
11' Hd  strictly  convex;  iiov.’ever,  and  we  omit  the  pi'oof,  the  strict  convexi.ty 
of  the  norm  can  be  used  to  show  uni  ci  ty  of  solution  of  each  of  the 
problems  P(\),  Pj^(\). 

Tn  [l],  a problem  similar  to  P(A.)  was  solved  which  also  reduces  to  a 
quadratic  pi'ogramming  pj-oblem  after  discretization  of  the  passband.  'fbe 
problem,  P (€),  was 


nnmmize 


J w(t) 


'k  t 


2 a,  cos  2nc,t  ' dt 
k=0  ^ ^ 


subject  to 


cos  PTiCj^t  ^ 1 + £ 


for  0 _<  t ^ tp. 


where  0 < £ < 1 and  u)  is  as  above.  (Actually,  in  [l],  only  the  ease  c,  — k 

( t 

was  considered.)  Tjet  Pj^(^)  be  the  discretized  version  of  P (£).  A^ain,  by 

t I 

the  strict  convexity  of  the  norm,  each  of  P (£)  and  Pj~)(€)  has  a unique 
solution. 


k 


3 . i':QU  iVAT.'vNCH  AND  7‘KOOF3 

Tjet  h (t)  3 S a,  cos  2nc,t  be  the  un  que  solution  to  P(A.). 

^ h =0  ^ ^ 

^V•not^^  G(A.)  = max  |l  - h (t)  | . Let  ^p,(^)  be  the  coi'i’eaponding 

0 < t < t 

— — p 

' 1 

number  for  Pj^(X).  The  following  theoiem  is  stated  for  P(\)  and  P (€),  but  a 

similar  theorem  is  ti-ue  for  the  discx-etized  vei'sions. 

t I 

Remark.  It  is  convenient  to  extend  the  problems  P(X),  P (O,  Pp(^) 

to  the  cases  \=0,1;  6 =0,1.  Existence  of  solution  for  these  problems  is 

still  true. 

Theorem  1.  Let  f,  w,  t , t and  c,  , k = 0,...,N,  be  fixed  as  above.  Each 
’ p’  s k JIT 

P(\),  0 \ ^ 1,  is  equivalent  to  some  P (€),  0 ^ 1 . ITiat  is: 

(1)  For  each  X,  0 < X < 1,  let  h be  the  solution  of  ?(X).  Then 
there  is  an  6,  0 < 6 < 1,  such  that  h is  the  solution  to  P (€);  and 

t 

(2)  For  a given  G,  0 ^ ^ 1,  let  be  the  un  que  solution  of  P (G). 

'flien  there  is  a A,  0 ^ A _<  1,  such  that  is  the  solution  to  P(A). 

Cur  fli'st  proof  also  applies  to  the  correspondiirg  discretized  version 
of  the  theorem.  A secoiid  proof  (for  that  version  only)  follows  winch  gives 
a valuable  insight. 

First  Proof.  (l)  Let  A be  giver^  0 ^ A ^ 1.  If  h^,  a solution  to  P(A), 

I I 

is  not  a solution  to  P (6(A)),  then  a solution  to  P (6(A))  would  be  better 

than  h in  P(A)  which,  of  course,  is  a contradiction. 

A. 

(2)  We  will  prove  the  second  part  of  the  theorem  by  showing  that 
6(A)  is  a decreasing  continuous  function  of  A and,  in  fact,  maps  [0,l]  onto 
itself.  It  is  clear  that  6(0)  = 1,  since  the  unique  solution  of  P(0)  is 


5 


I 


h (t)  H 0.  Similarly,  6(l)  = 0.  Lcmina  1 below  is  used  to  prove  tliat 


is  decreasing. 


L.-mma  1.  if  0 < < Xg  ^ ^2  ^2  ^ ^1’  eith« 

(A)  X^a^  + (1  - ^ ^2^2  + ~ ^p^^2 

or  (B)  X^a^  + (l  - ^ ^1^1  + 


^1  - ^2  S 

Pi'oof  of  Tjeirima  1.  Either  (i) < or 

^2-^1  ^ - ^2 


/. . N ^1  ~ ^2  , ^1  . , ^2 

aTTT-  > < i-tt; 


. Clearly,  (i)  implies  (A) 


and  (ii)  implies  (B).  Lemna  1 is  pi-oven. 


If  we  had  X^  < Xg  'with  6(X^)  < ^(Xg)*  we  would  arrive  at  a contra- 


diction to  Lc-riirna  1;  hence,  €(X)  is  decreasing  for  0 < X < 1.  Also 


6(0)  = 1 > 6(X)  > 0 = 6(1)  for  0 < X < 1. 

The  continuity  of  6(X)  can  be  established  by  a 3traigrafoi’'Wird 


argument , 


Second  Proof  (for  discretized  version).  Convexity  of  the  positive  definite 


quadratic  pai't  of  the  objective  functions  and  convexity  of  the  constraint 


functions  guarantee  applicability  of  the  Kuhn-Tucker  conditions  to  both 


P (X)  and  Pn(^)>  Por  0 < X < 1 and  0 < 6 < l.(See  [3],  pp.  20,  90.)  'fhe 


special  cases  X = 1 and  6 = 0 give  the  special  solution  h(t)  1.  For  the 


other  cases,  define  the  approximating  function 


h (a,t)  = S a.  cos  2nc.t 
i-=l  ^ 


6 


and  non-n'3tj;atlvi3  oonsti'a-i nt  fvmotiona 


= (h(a,t.  ) - 1)^ 


b,  b > 0 
0,  b < 0 


Necessary  and  sufficient  Kutjn-'Ricker  co;>di  ti  ons  for  (a^ , > • • - » = ^ = 


to  be  a solution  to  P^(€  ) are 

D'  o 


1 2 

0 grad  l|h  + S cr^  grad  Sy  (a)  + ^ a“  grad  gj^^_(a^)j 

a k=l  a ' k=l  a 


<^k  >0.  \ > 0, 


a,  (g,  (a  ) - 6 ) = 0, 
k ' k-'  o ’ 


k = 1 ,2, . . . ,m. 


-1 


If  we  first  multiply  the  objective  function  in  ?£)(^)  by  (l  - \)  , it  is  easy 

to  see  that  Pj-j(^)  is  equivalent  to 


minimize  + ||h  1|^ 


subject  to  g,  (a)  < p 

K+  — — , 


Sk-^-)  P » 


where  u = r . 'Ibe  Kuhn-Tucker  conditions  for  a global  minim\un  for  this 

« 1 - X 

problem  at  a =z  a are 
— o 


u.v.diiit!..  . . I ■ » • • •■■■  ■ 


7 


m 


m 


0 = grad  l|h  \\^  + E n grad  Ky  (^)  + T-  ^rad  Sj^^_(£) 

a k-1  ' a " k-rl  ~ a 


ra 


(.^) J 0 = ?|.j)  . 


^ ° » 


^k+^®k/V'  - P)  > 0 , 
Pj^_(Sk_(^o^  ~ p)  ^ 


k = 1,?, . . . ,ra. 


Notice  that  if  we  start  with  the  ininiMum  point,  a^,  of  Pj-)(^q)>  then  set 

-1 

^k+  " ‘^k+’  ^ " 1, ?,..., m,  and  \i^  = 1-6^  E , the  K'oim-Tucker 


■°  k.,1  ^ 


conditions  (**)  will  be  satisfied  for  P„(p  ) and  hence,  a is  the  ininirniim 
' D CO  O 

point  for  P^(u  ).  Note  that  €u  = G will  be  the  solution  value  of  n. 

D to  * o 

If  a is  the  minimum  point  for  P-,(^.  ),  then  again  set  a,  = u,  and 
o D o kjf  kj^ 

I t 

G = p and  we  see  that  at  a^,  (*)  also  is  satisfied  and  so  a^  is  the  minimom 
point  for  P^(G).  (However,  this  half  of  the  theorem  is  iicmediate  as 
sho'wn  in  the  beginning  of  the  first  proof,  above.) 


MJI-ii-iRlCAL  EXAMPLES 

We  will  compare  the  solution  of  a problem  of  type  P (G)  given  in  [l] 
with  solutions  of  Pjj(^)  for  various  values  of  All  of  the  computation 
was  done  with  a computer  progra,m  called  QPS  which  was  available  at  the 
University  of  Phode  Island  Computer  Center.  The  algoritlim  that  it  uses  is 
based  on  numerical  methods  described  in  [p]. 


8 


We  will  lake  ^ w(t)  e 1,  as  In  the  examples  in  [l].  The 

other  specific  quantities  were: 

m =.  hi,  t = 0.002  (i  - 1),  i = 1,?,,..,51. 

i ’ 

, = o.i;^5, 

N = 14 

f 

6 = 0.035. 

'Hie  solution  n [l]  yielded  a value  of  O.OOO6  for  the  integral  of  the  fimc- 
tion  over  the  stopband. 

To  illustrate  the  discrete  version  of  Theorem  1 we  solved  numerically 
P^(X)  for  various  values  of  K.  Some  iraiaerical  results  are  given  in  Table  I. 
■We  see  that  the  solution  of  Pjj(4)  with  \ = O.I65  corresponds  approximately 
to  the  solution  of  the  problem  Pq(^)  given  in  [l]. 


TABLE  I 

SOLUTION  OP  Pj^(X)  PX)R  SOME  X 

X 

INrEGPJtL  OVER 
STOPBAND 

0.1 

0.046 

0.00046 

0.165 

0.035^ 

0.00057 

0.2 

0.030 

0.00064 

0.5 

0.017 

0.00080 

0.8 

i 

0.014 

0.00104 

9 


APPKNDLX 


Tliforftin  ?.  T^et  A and  B be  bounded  sets  of  real  numbers  and  let  \G(0,1) 


be  a fixed  consta.nt.  T^ot  H'll.  be  a noi’m  (seini-norm)  on  C(A),  the  set  of 


c^uitinuous,  real  valued  functions  on  A,  and  let  !|'lL  be  a norm  (semi -norm) 


C(B).  Tlien  the  "mixed  noim"  ("mixed  semi -noi  m" ) defined  by 


jgf  = + (1  - A)llglg 


■.  3 a noi  ’in 


(sc-mi-noi-ra)  on  C(A)  fl  C(B). 


Proof.  The  only  condition  that  is  not  immediate  is  the  triangle  Inequality. 
We  will  show  that 


!|f  + ef  < + I'slD^  = l|fli 


2 + !'gl|2  ^ 2!!f"  I'g!'. 


Let  f and  g be  in  C(A.)  H C(B).  Then 


I’f + gf  . >.l'f +e!l?  + (1  - ^)!'f + gl'o 


< Al'frJ  + PXllflM'g!'^  + Al'gll^  + (1-X)lif|!|  + 2(l-\)ff!l^!'g!' 


B 


(1  - x)iigl'; 


= lifjl^  + !'gli^  + + ?^(1  - x)lifL l!g|i 


A''=’"A 


if II,.  X^lgP,  + (1  - X)2l|f|l  . (1  - X)2l'^l’  ], 


We  apply  the  Cauchy-Sehwarz  inequality  in  R to  the  quantity  in  the 


square  brackets  and  get: 
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